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Abstract 

In this paper we analyse a dynamic model of investment under uncertainty in a duopoly, 
in which each firm has an option to switch from the present market to a new market. 
We construct a subgame perfect equilibrium in mixed strategies and show that both 
preemption and attrition can occur along typical equilibrium paths. In order to determine 
the attrition region a two-dimensional constrained optimal stopping problem needs to be 
solved, for which we characterize the non-trivial stopping boundary in the state space. 
We explicitly determine Markovian equilibrium stopping rates in the attrition region and 
show that there is always a positive probability of eventual preemption, contrasting the 
deterministic version of the model. A simulation-based numerical example illustrates 
the model and shows the relative likelihoods of investment taking place in attrition and 
preemption regions. 
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1 Introduction 

Consider the following innocuous sounding investment problem involving two coffee shops 
operating a similar franchise in a town. The profitability of each hrm is influenced by some 
stochastic process, representing uncertainty over the evolution of demand, costs, etc. Each 
firm has an option to engage in product differentiation by switching to a rival franchise. When 
should a firm switch franchise, if at all? This economic situation is a very basic example of a 
timing gar?T,e0 
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^This is a game because the actions of one firm have an influence on the other firm, in that if one coffee 
shop switches the other firm becomes a (local) monopolist in the original franchise. 


1 



In the literature on timing games a distinction is typically made between wars of attrition 
and preemption, which result from situations with a second-mover or first-mover advantage, 
respectively. In a game with a first-mover advantage there is a pressure on players to act 
sooner than is opti mal because of the fear of be ing preempted by the other player. In the 
classical analysis bv iFudenberg and Tirold (119851 ) it is shown that the first-mover advantage 
of becoming the leader is dissipated by preemption, inducing rent equalization in that both 
firms obtain the second-mover, or follower payoff in expectation. In games with a second- 
mover advantage the situation is radically different, because in such games each player wants 
the other player to move fir st. This can lead play ers to take on some costs of waiting in 
equilibrium, as shown e.g. by 


Hendricks et al 


Jl988lb 


Timing games have been used for instance in the industrial organization literature to ex¬ 
plain a plethoraoHghenomena^.deaJm 2 .^ith^.suchHssues_as.^echnolo 2 ^.ado 2 tioi^Fudenberg 


and T irole. Il985lb firms’ exit decisions in a duopoly (jFudenberg and Tirold . Il986l i. and patent 
races (|R,einganuml . 119821 1 . Relatively early on in the development of the real options theory of 
investment under uncertainty it was recognized that real options, unlike their financial coun¬ 
terparts, are usually non-exclusive and that, thus, a game theoretic approach is needed. Many 
contributions in this literature have focussed on analysing markets with a hrst-mover advan¬ 
tage]^ The literature on game theoretm real option s mod els with second-mover advantages is 
less well-developed, with iHoppel (j200Cll and iMurtd (j200411 being notable exceptions. 

In this paper we want to think about duopolies in which both attrition and preemption can 
occur, depending on the evolution of the market environment, and to construct a subgame 
perfect equilibrium for such games. It is in such a model that the true power of stochastic 
versus deterministic models becomes clear. Typically, in models with either a first- or second- 
mover advantage, regardless of whether the model is deterministic or stochastic, it is clear 
a priori what will happen in equilibrium: preemption in case of a hrst-mover and attrition 
in the case of a second-mover advantage. It is just the timing that is different: on average 
investment takes place later in a stochastic model. However, in many real-world situations it 
not clear whether a market will develop into one with a hrst- or second-mover advantage. In 
such cases one has to resort to a stochastic model. 

Returning to the coffee franchise example, a switch by either hrm changes the hrms’ 
prohtabilities in two ways: (i) there is a change in market structure and (ii) the stochastic 
shocks under the new franchise follow a different process. The economic conhict here is the 
influence that each firm has over its competitor by switching to the other franchise. If only 
one firm switches, then each firm will operate as a monopolist in its respective market. This 
is good for both firms, but potentially best for the hrm that does not switch, because it does 


non-ex h austive list o f contr i butions is ISmet j Jl99 ji. iHuisman and KortI iThiissen et all il2012ll . 

IWeedj (l2002h . iBover et_ajj j[200jjjJPawjinn_aJid_j<ortjj[200gj^_Extensiye_survgYS_caiyj^^ 

Roignant and Trigeorgis (l201lh and lAzevedo and PaxsonI ll2ni4h . 
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not incur the sunk costs. This could lead to a war of attrition, i.e. a situation where it is 
profitable for each firm to switch, but each prefers the other firm to do so. On the other 
hand, if the profitability in the new market is higher than in the current market but not high 
enough to make a duopoly in the new market profitable, then a situation of preemption may 
occur. In such cases firms may try to switch before it is optimal to do so. 

The novelty of the model we develop is that it can deal with attrition and preemption 
simultaneously. We do this by using a two-dimensional state space, roughly speaking corre¬ 
sponding to the profitability in each of the two markets. In equilibrium this state space will 
effectively be split into three regions: a preemption region where both players try to preempt 
each other, an attrition region where each hrm prefers its competitor to invest, and a contin¬ 
uation region where neither firm acts. Along a sample path the following may happen. If the 
state hits the preemption region, then at least one firm invests instantly. If the state moves 
through the attrition region, each firm invests at a certain rate (the attrition rate) until either 
the preemption region is hit, or the attrition region is left towards the continuation region. 
Inside the latter nothing happens until either the preemption region is hit directly or the 
attrition region (again). 

The richness of this model does present some technical challenges. Firstly, in regimes with 
a second-mover advantage, payoffs of pure-strategy equilibria are generally asymmetric and 
each firm prefers to become follower. Determining the roles is then a (commitment) problem 
left open. By considering mixed strategies we can make the firms indifferent. With uncer¬ 
tainty, however, the attrition region where the mixing occurs can be entered and left repeatedly 
at random. We nevertheless obtain an equilibrium with Markovian stopping probabilities per 
small time interval (the so-called attrition rate), while deterministic models typically contain 
some simplifying smoothness assumption on the payoff functions. In the latter case the evo¬ 
lution of the game is not only perfectly predictable, but also “slow”. Thus, when the attrition 
rate becomes unbounded near the preemption region as the second-mover advantage van¬ 
ishes, stopping occurs a.s. before reaching the preemption region. With our faster stochastic 
dynamics, in contrast, there is always a positive probability of preemption to actually occur. 

Another important issue relates to the value functions of the leader and follower roles. 
Along a sample path, the game end s for sure as soon as the pre emption region is entered. 
This result has been known since the iFudenberg and Tirold (|l985l l analysis of a deterministic 


preemption game. In our paper subgame perfection leads to similar equilibrium behavior. 
Consequently, firms know ex ante that the game “ends” as soon as the preemption region is 
first hit. Working backwards, this means that firms must take this into account when they 
choose their strategy in the attrition region. In particular, as we will see, this has an effect 
on the attrition region itself. Determining this region will require solving a genuinely two- 
dimensional constrained optimal stopping problem. There are no known general techniques 
to solve such problems (ours cannot be transformed into a one-dimensional problem like some 


3 





models considered in the optimal stopping literature), but we are able to show that, quite 
remarkably, our model has enough structure to fully characterize the attrition and preemption 
regions. 

Finally, we propose a simulation-based approach to numerically analyse the model. This 
simulation shows, for a particular starting point in the continuation region, that many sample 
paths actually reach the preemption region via the attrition region. This shows that our 
results on stochastic versus deterministic models are economically important. 

The paper is organized as follows. In Section [2] we present a stochastic dynamic model of a 
market in which both first- and second-mover advantages can occur. In Section [3] we describe 
the paper’s results in an informal way. The timing game is formally defined, analysed and 
discussed in detail in Section 01 In particular we construct a subgame perfect equilibrium in 
mixed (Markovian) strategies in Section 031 An important part of this construction consists of 
solving a constrained optimal stopping problem in Section 14.31 Section 0 present a numerical 
example that we use to discuss the economic content of our results and in Section 01 we 
contrast our stochastic analysis with its deterministic version. Finally, Section [71 provides 
some concluding remarks. 

2 A Model with First- and Second-Mover Advantages: Prod¬ 
uct Differentiation in a Duopoly 

Consider two firms that are producing a homogeneous good. For instance, the firms could 
be two coffee shops operating a similar franchise A in a town. The profitability of each 
firm is influenced by some stochastic process. Each hrm has an option to engage in product 
differentiation and switch to a different franchise B. This switch involves some sunk costs (for 
example due to refurbishment). To make matters more concrete, suppose that when firms 
operate the same franchise Bertrand competition implies that both firms make no profits. If, 
however, firms operate a different franchise both can be seen as monopolists in their respective 
markets and they will earn some profit streams. The monopoly profits in franchises A and 
B are given by the processes X = {Xt)t>o and Y = {Yt)t>o, respectively, while there are 
no profits in duopoly in either franchise. There is a sunk cost of switching / > 0. For 
completeness we consider some additional running costs before and after switching denoted 
by Co, CA and cb, respectively, but these have no qualitative impact and may also be ignored. 
Depending on the net present value of the two monopoly profits X and Y and the total costs 
of switching, it may at any time be more profitable to switch to the new market, to become 
monopolist in the current market, or to stay in duopoly. 

To obtain some explicit results we assume that X and Y are geometric Brownian motions. 
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specifically as the unique solutions to the system of stochastic differential equations 


dX , 

— = nxdt + axdB 
Ji. 


dY 

and = ^ydt + aydB^ 


( 2 . 1 ) 


with given initial values (Xo,lo) = {x,y) € B^ and B^ are Brownian motions that 
may be correlated with coefficient p, and px, Py, crx and cry are some constants representing 
the drift and volatility of the growth rates of our profit processes X and Y, respectively. 
We assume c7^,cry > 0 and \p\ < 1 to exclude potential degeneracies that require separate 
treatment (the case ax = cry = 0 is considered in Section ED . We also assume that profits are 
discounted at a common and constant rate r > max(0,/ix,/Uy) to ensure finite values of the 
following payoff processes and the subsequent stopping problemsjf] 

Following the previous discussion, the basic payoffs can now be formulated by processes 
L, F and M, which represent the expected payoffs at the time of the (first and only) switch to 
(i) a, firm that switches solely and becomes the leader, (ii) a firm that remains and becomes 
the follower and (in) a firm that switches simultaneously with the other, respectively. 

At any time t > 0 these processes take the values 


L, := 


- / e-^^cods + E 

Jo 


e ^^(i; - cb) ds 




r 


Yt 


CB - Co 


r — py r 

oo 


Ft : = 


pt poo 

- e-^^cods + E / e-^%Xs-CA)ds 

Jo Ut 


-I] :=L{t,Yt), 




r \r - px 


Xt 


CA — Co 


■■=F{t,Xt) 


( 2 . 2 ) 


and 


Mt := - 


’co ds — e 


10 

Co 


-e 

r 
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Note that these processes are continuous thanks to their respective representation by a con¬ 
tinuous function of the underlying continuous profit processes X and Y. By those Markovian 
representations we may also evaluate the payoff mocesses at any stopping time at which the 
switch might occur to obtain the correct payoffs □ All payoff processes are further bounded 

®Then is bounded by an integrable random variable. Indeed, for ax > 0 we have supj = 

with Z = supt — t (r — h x + a^ 12) jax, which is exponentially distributed with rate 2{r — fj,x)/ax + 
ax (see, e.g.. IHevuz and (Il999h . Exercise (3.12) 4°). Thus, i?[supj = Xo{l + ax/2{r — fix)) £ R+, 

implying that {e~'^*Xt) is of class (D); analogously for ax < 0 and Y. 

'^If the switch occurs at a stopping time r, one has to take conditional expectations at r to determine the 
appropriate payoff Lt for example, which in general need not be consistent at all with a family of conditional 
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by integrable random variables, cf. footnote El and they converge to —cojr =: Loo as t —>■ oo. 

We assume that it is optimal for only one firm to switch, specifically (cq — CA)lr + / > 0 
to ensure F > M, and that the relative capitalized total cost of a single firm that switches is 
nonnegative, i.e., {cb — ca)It + / > 0. 

The firms will try to preempt each other in switching to the franchise B when L > F, 
which is the case iff 


{X,Y)er:={{x,y)eRl 


y>{r-yY 


)( 


X 

r- nx 


l CB - CA 

r 



We accordingly call V the preemption region of the state space of our process {X,Y). 
When F > L, each firm prefers to be the one who stays if there is a switch, which potentially 
induces a war of attrition. We will model this strategic conflict as a timing game. 


3 An Informal Preview of the Results 


At this stage it is instructive to analyse the model informally and anticipate the equilibrium 
construction that follows. To begin, in line with the literature on preemption games our game 
has to end as soon as the set V is hit. However, to model this preemption outcome it is 
not enough to consider distribution functions over time as (mixed) strategies §] As there is no 
“next period” in continuous time, one has to enable the firms both to try to invest immediately 
but avoiding simultaneous investment at least partially, in particular on the boundary of V, 
where they are still indifferent. We follow the endogenous approach of iFudenberg and Tirok 
(|l985l l. augmenting strategies by “intensities” ai € [0,1] that determine the outcome when 
both firms try to invest simultaneously like in an infinitely repeated grab-the-dollar game. 
A firm that grabs first invests. If firm j grabs with stationary probability aj > 0, firm i 
can obtain the follower payoff F by never grabbing, and ajM + (1 — aj)L by grabbing with 
probability 1. Hence the firms are just indifferent between both actions in equilibrium if 


L-F , , 

ai = a2 = a = G (0, IJ, 


implying the expected local payoffs F (note that we have F > M). With symmetric intensities 
the probability that either firm becomes leader is then 

a(l — a) + (1 — — a) + ■ ■ ■ = - 

2 — a 

Taking limits, that probability becomes ^ on the boundary of V where a vanishes (see Remark 
IA.2I in the Appendix on the limit outcome). In the interior of V, however, there is a positive 

expecta tions indexed by deterministi c times t and a pointwise construction via t = r{Lj). 

^See [Hendricks and Wils'^ (Il992h for a proof of equilibrium nonexistence. 
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probability a/{2 — a) of simultaneous investment representing the cost of preemption, in 
contrast to more ad hoc coordination devices. 

Now consider states outside V. Suppose first that some firm tries to determine when it 
would be optimal to make the switch and obtain the leader value L, which directly depends 
only on Y. If the competitor could not preempt the firm, standard techniques would yield 
that there is a threshold y* that separates the continuation region, where the firm remains 
inactive, and the stopping region where the firm makes the switch. The optimal stopping time 
is thus the first time the process Y enters the set [y*, oo) and the process X plays no role in 
this problem at all. 

The firm should realize, however, that as soon as V is hit the game is over and it receives, in 
expectation, the follower value, which does depend on X. Thus the firm should actually solve 
the constrained optimal stopping problem to become leader up to the first hitting time of V. 
Intuitively, the solution to this problem should again divide the (genuinely two-dimensional) 
state space into two sets: a continuation set C and a stopping set A. The boundary between 
these regions turns out to be given by a mapping x !->■ b{x), see Figure [TJ b{x) increases to 
y* for X —>■ oo, since then the probability of reaching V while waiting to get closer to the 
unconstrained threshold y* is small. 



Figure 1: Continuation, Attrition and Preemption regions^ 

For smaller values of x, however, there is a higher risk to get trapped in preemption if V 
is hit with Y < y*. Thus it may be better to secure the current leader value before V is hit 
at a possibly even lower value. We formally show that it is optimal to stop strictly before 
V U M+ X [y*, oo) is hit in the constrained stopping problem, i.e., the stopping boundary b{x) 
lies below that region (in particular when preemption is “near”). In the interior of the stopping 
set A we now have a situation alike a war of attrition: waiting without a switch occuring is 
costly (the constrained leader value decreases in expectation), but becoming follower in this 
region would yield a higher payoff F > L. 

®The definitions of y and y-p will become clear in Section [531 
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We characterize the attrition region A below in terms of the stopping boundary b(x) for 
the constrained leader’s stopping problem and identify the cost of waiting in this region as 
the drift of L. In equilibrium the firms are only willing to continue and bear the cost in 
A if there is a chance that the opponent drops out, yielding the follower’s payoff. We will 
propose symmetric Markovian equilibrium hazard rates of investing - called attrition rates - 
that make both firms exactly indifferent to continue in A. If we denote those rates here by 
At to give a heuristic argument, the probability that a firm invests in a small time interval 
[t, t + dt] is At dt. Since each firm is supposed to be indifferent to wait, the equilibrium value 
(i.e., expected payoff) V) should satisfy 




Ft = FtXt dt + {l- At dt)E[Vt+dt I ^t] 
-E[dVt\^t] 

* Et-Vt- E[dVt I ^t] ■ 


EtXt dt + {l- At dt)E[Vt + dVt I ^t] 


On the other hand we should have V=L in A by indifference and since the probability of 
simultaneous investment is zero if the other firm invests at a rate. Hence E\dVt | ^t] is the 
(here negative) drift of Lt of order o{dt)^ implying 


E[dL.|.y.l 

F,-L, 

We will model strategies more generally as distribution functions Gi{t) over time, such 
that the hazard rates are actually Xtdt = dGi{t)/{l — Gi{t)). Note that in contrast to 
deterministic models that develop linearly (with time t the state variable), we have to account 
for the possibility that the state enters and leaves the attrition region frequently and randomly, 
which makes indifference much more complex to verify. A distinctive feature of the exogenous 
uncertainty is that there is always a positive probability of reaching the preemption region with 
no firm having invested before, although the hazard rates Xt grow unboundedly as H — L —>■ 0 
near V; the latter does enforce investment in the deterministic analogue. 


4 Formal Analysis of Subgame Perfect Equilibria 

In this section we present and discuss in more detail the formal results that have been in¬ 
troduced informally in Section [3l We start by formalizing the timing game (in particular 
strategies and equilibrium concept) in Section HTTl followed by establishing equilibria for sub¬ 
games starting in the preemption region V in Section 14.21 The constrained optimal stopping 
problem that identifies the attrition region A is analysed in Section 14.31 In Section 14.41 we 
establish (Markovian) equilibrium strategies for arbitrary subgames. 
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4.1 Timing Games: Strategies and Equilibrium 


We use the framework of subgame perfect equh ibrium for stochastic timing games with mixed 
strategies developed in iRiedel and Sted (j2014ll . There is a fixed probability space (O,^, P) 
capturing uncertainty about the state of the world, in particular concerning future profits. Our 
firms can decide to switch to the new market B in continuous time t G R+. The decision when 
to switch can be based on some exogenous dynamic information represented by a filtration 
F = (^t)t>o satisfying the usual conditions (i.e., F is right-continuous and complete). It 
includes the current observations of the profit processes X and T, hence L, F and M are 
adapted to F, too. 

The feasible decision nodes in continuous time are all stopping times. Therefore any 
stopping time •& represents the beginning of a subgame, with the connotation that no firm has 
switched before. Let denote the set of all stopping times w.r.t. the filtration F. 

We will specify complete plans of actions for all subgames, taking the form of (random) 
distribution functions over time. These have to be time-consistent, meaning that Bayes’ rule 
has to hold wherever applicable. Additional strategy extensions serving as a coordination 
device are needed to model preemption appropriately in continuous time. 


Definition 4.1. An extended mixed strategy for firm i G {1,2} in the subgame starting at 
d G , also called id-strategy, is a pair of processes (Gf, of) taking values in [0,1], respectively, 
with the following properties. 

(i) Gf is adapted. It is right-continuous and nondecreasing with Gf{t) = 0 for all t < id, 

a.s. 

(ii) af is progressively measurablelll It is right-continuous where af < 1, a.s§ 

(iii) 

af (t) > 0 ^ Gf (t) = 1 for all t >0, a.s. 


We further define Gf(0—) = 0, Gf{oo) = 1 and af(oo) = 1 for every extended mixed strategy. 


Any stopping time r > can be interpreted as a pure strategy corresponding to Gf (t) = 
lt>T for all t > 0. If the Gf jump to 1 simultaneously, the extensions af determine the actual 
outcome probabilities, so that simulta neous stopping is avoidable t o a certain extent. The 
a-components were first introduced bv iFudenberg and Tirolel (jl985l l for deterministic games 


^Formally, the mapping af: Q x [0,t] —>■ M, {oJ,s) i—>■ af(uj,s) must be ® i^([0, t])-measurable for any 
t € R+. It is a stronger condition than adaptedness, but weaker than optionality, which we automatically have 
for Gf by right-continuity. Progressive measurability implies that af (r) will be .^r-measurable for any r G 
®This means that with probability 1, af{-) is right-continuous at all t € [0, oo) for which af{t) < 1. Since 
we are here only interested in symmetric games, we may demand the extensions af(-) to be right-continuous 
also w here they take the value 0, which simplifies the definition of outcomes. See Section 3 of iRiedel and St^ 
(l2014li for issues with asymmetric games and corresponding weaker regularity restrictions. 
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and allow for instantaneous coordination in continuous time. They can also be thought of as 
measuring the “preemption intensity” of firms as they determine the probabilities with which 
each firm succeeds in investing. In particular, at := inf{f > 'd\af{t) + afCO > 0}, the 
extensio ns determine final outcome probabilities ■. Ar ■ and as defined in Riedel 


and Steg ( 20141 ). which we provide for completeness in Appendix IA.21 Here Af j and j 
denote the probabilities that firm i becomes the leader or follower, respectively. is the 
probability that both firms invest simultaneously. Since the latter outcome is never desirable 
(in the sense that firms would rather be the follower than end up in a situation of simultaneous 
investment) this outcome has traditio nally been referred to as a “coordination failure” (see, 
for example, iHuisman and Kortl . 11999( 1. 

Now that the strategies have been formalized, we can define the firms’ payoffs. As with 
strategies, these have to be defined for every subgame. 

Definition 4.2. Given two extended mixed strategies (Gf,a f), ijG {1,2}, ij^j, 

the payoff of firm i in the subgame starting ai'd £ is 


'ir'd (^'d . 

G , a* , Gj ,aj) : 


= E 


[ (l-G^{s))LsdGf{s) 

+ [ (l-Gf{s))F,dG^{s) 

+ ^ AGfis)AG^{s)M, 

sG[0,f’’) 




Since iJ-strategies need to be aggregated across subgames, we need to introduce a notion 
of time consistency. 

Definition 4.3. An extended mixed strategy for firm i € {1, 2} in the timing game is a family 

(G„aO ;= iGf,af)^^^ 

of extended mixed strategies for all subgames d £ 3^. 

An extended mixed strategy {Gi, ai) is time-consistent if for d <d' £ 

d'<t£n+^ Gfit) = Gfid'-) + (1 - Gtid'-))Gf{t) a.s. 

and 

d' < T £ ^ ^ af{T) = af (r) a.s. 


Now the equilibrium concept is standard. 
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Definition 4.4. A subgame perfect equilibrium for the timing game is a pair (Gi, ai), (G 2 , 02 ) 
of time-consistent extended mixed strategies such that for all ?? G ^, i,j € {1, 2}, i j, and 
extended mixed strategies 


/o-i? 

1 1^ j 1 


a. 


)>Vf{Gt,a:,Gla^) a.s. 


i.e., such that every pair (Gf,af), (Gfjof) is an equilibrium in the subgame at G , 
respectively. 


4.2 Preemption Equilibria 


We start our construction of a subgame perfect equilibrium by considering subgames with a 
first-mover advantage > F^, i.e., starting in the preemption region V, where we can refer 
to the following established equilibria in which at least one firm switches immediately. 


Proposition 4.5 (jRiedel and Sted (j2014lh Proposition 3.1). Fix H € iF and suppose H = 
inf{t >'i9\Lt> Ft] a.s. Then (Gf,a5?)> (Gf,®!) defined by 



^Lt>Ft 


Lt-Ft 

Lt-Mt 


for any t G [ 1 ?, 00 ) and Gf = lt>u, * = 1)2, are an equilibrium in the subgame at'd. 

The resulting payoffs are Vf {Gf, af, G'j , Oj) = Ej. 

In these equilibria, the firms are indifferent between stopping and waiting. The latter 
would mean becoming follower instantaneously, as then the opponent switches with certainty. 
If > Fsff, then there is a positive probability of simultaneous switching, which is the 
“cost of preemption”, driving the payoffs down to Of particular interest are however 
subgames it with = F^, where each firm becomes leader or follower with probability ^ in 
the equilibrium of Proposition 14.51 (given the outcome probabilities defined in Section [A.2p . 
This is in particular the case in “continuation” equilibria at r-p('d) := inf{t > 'd | > Ft] 
(where the game will hence end with probability 1) for subgames which begin with < F^. 
By these continuation equilibria the firms know that if the preemption region is ever reached, 
then each firm can expect to earn the follower value at that time. This observation will turn 
out to be important for constructing the equilibrium in the case of attrition. 


4.3 Constrained Leader’s Stopping Problem 

We now turn to equilibria for subgames beginning outside the preemption region where we will 
observe a war of attrition in contrast to typical strategic real option models in the literature, 
in which only preemption is considered. Our equilibria are closely related to a particular 
stopping problem that we hence discuss in detail. Its value (function) will also be the player’s 
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continuation value in equilibrium and its solution is needed to characterize and understand 
equilibrium strategies. This stopping problem is also of interest on its own as it is two- 
dimensional and therefore not at all standard in the optimal stopping literature. 

In accordance with Proposition 14.51 we fix the (equilibrium) payoff F whenever the state 
hits the preemption region V. Suppose now that only one firm, say i, can make the switch 
before V is reached. Then i can determine when to become optimally the leader up to hitting 
V, where the game ends with the current value of F as the expected payoff. 

Letting r-p := inf{t > 0 | {Xt, Yf) € V} = inf{t > 0 | L* > Ft} denote the first hitting time 
of the preemption region V, firm i now faces the problem of optimally stopping the auxiliary 
payoff process 

L .— L\t<T-p T FT-^it>T-p ■ 

It obviously suffices to consider stopping times t < T-p. We are also only interested in initial 
states (XojTo) = {x,y) G which implies Fj-^ = Lj-^ by continuity. Then the value of our 
stopping problem is 

Vi{x,y) := ess sup Li [Lt] = ess sup Li [L,-] 

T€[0,r-p] 

for (Xq, Yq) = (x, y) € (and Vi{x, y) := Fq for (Xq, Yq) = (x, y) G V). Thanks to the strong 
Markov property, the solution of this problem can be characterized by identifying the stopping 
region of the state space {{x,y) G | Vi{x,y) = Lq for (Xo,To) = ix,y)} = V Li {{x,y) G 
I Vi{x,y) = L(0,y)} and the continuation region 


C := {(x, y)^V^\ Viix, y) > L(0, y)} C PT 


By the continuity of L (resp. L) it is indeed optimal to stop as soon as {X, Y) hits C^. 

The stopping and continuation regions are related to those for the unconstrained problem 
sup^>Q Li[LT-], which only depends on Y and its initial value Yq = y- This is a standard 
problem of the real options literature, e.g., which is uniquely solveqj by stopping the first 
time Y exceeds the threshold 


* /3i . T , - co\ 


A- 


with /3i > 1 the positive root of the quadratic equation 

Q(/3) = - 1) + yvli - r = 0. 


(4.1) 


At y*, the net present value of investing in as a monopolist is just high enough to offset 

®The solution also holds in the degenerate case Vb = y* = 0, iff L is constant, but then it is not unique, of 
course. 
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the option value of waitingl^ 

Now the constraint is binding iff the stopping region for the unconstrained problem does 
not completely contain the preemption region V, which is the situation depicted in Figure [T] 
above with 


y* > yv ■= {r - yr) ^ 0 


Indeed, as stopping L is optimal for > y* in the unconstrained case, it is too under the 
constraint t < r-p. Hence, if y* < y-p, the continuation regions for the constrained and 
unconstrained problems agree. 

In the displayed case y* > vy, however, we have a much more complicated, truly two- 
dimensional stopping problemo Then the stopping region for L extends below V U {(x, y) G 
1^+ \y > y*} due to the risk of hitting V at a lower value of Y when {Xq, Tq) is close to V but 
below y*. Stopping is dominated, however, below the value 


y := CB - cq + rl, 


where the drift of L is positive, whence also y < y* if either is positivellfl Furthermore we 
show in the proof of the following proposition that it is always worthwhile to wait until Y 
exceeds at least y-p (if this is less than y*). The continuation region C and the stopping region 
for L are then indeed separated by a function b{x) as shown. 

Proposition 4.6. There exists a function b : M_|_ —)■ [min(yp, y*), y*] which is nondecreasing 
and continuous, such that, up to the origin. 


C = {{x,y) \ y <h{x)] 


and Tc<^ := inf{t > 0| {Xt,Yt) G C^} attains Vi{x,y) = E[Lri,f\ for (Xo,To) = {x,y) G M^. 
The origin belongs to C iff y* > 0, i.e., iff y > 0. In that case b further satisfies b{x) > 
min{y,yp + x{r — pLy)/— hx)) (and otherwise b = y* andC = tb). 


Above y*, the forgone revenue from any delay is so high that investment is strictly optimal. Below y*, the 
depreciation effect on the investment cost is dominant to make waiting strictly optimal. 

> 0 by our assumption on the parameters. 

Genuinely two-dimensional problems and their free boundaries are rarely studied in the literature due 
to their general complexity. Sometimes problems that appear two-dimensional are considered, e.g. involving 
a one-dimensional diffusion and its running supremum , which are then reduced to a one-dimensional, more 
standard problem. See, e.g.. lPeskir and ShirvaevI ll200(Il . 

^®The drift of L, — y) dt, can be derived by applying Ito’s formula to L{t, Yt) in (12.211 . With y we 

also have 



-y) ds 



It holds that y = 0 j/* = 0 and otherwise y*/y G (0,1), since Pipy < r (obviously if py < 0 and due 

to Q{r/py) > 0 in (14.11) if py > 0); furthermore y > y-p iff (cq — ca)I{cb — ca -|- rl) < py/r, e.g., if cq is 
sufficiently small or if I or cb are sufficiently large (while py > 0). 
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Proof: See appendix. 

We show in Lemma SSI below that indeed b < y* y-p < y*; nevertheless b{x) y* 
since the value of the constrained problem converges to that of the unconstrained problem as 
^ oo. 

By the shape of C identified in Proposition 14.61 a firm that was sure never to become 
follower outside V would switch as soon as the state leaves C: any delay on {Y > b{X)}r\{F > 
L} would induce a running expected loss given by the drift of L, which is — y)dt<0 

there. Switching would yield the other, staying firm the prize F > L, however. Since both 
firms face the same situation, we obtain a war of attrition in the stopping region of the 
constrained stopping problem: there is a running cost of waiting for a prize that is obtained 
if the opponent gives in and switches. Therefore we call it the attrition region 

A := {{x, y) G I ?/ > b{x)} \ 7^0 

In order to derive equilibria outside the preemption region V, we need to know exactly 
the expected cost of abstaining to stop in A. In general this need not be just the (negative of 
the) drift of L, — y) dt > 0 in A, since the state can transit very frequently between A 

and C0 Our equilibrium verification uses the following characterization of the constrained 
stopping problem and the cost of stopping too late. By the general theory of optimal stopping, 
the value process of the stopping problem Vi{X,Y) := Up is the smallest supermartingale 
dominating the payoff process L, called the Snell envelope. As a supermartingale it has a 
decomposition 11^ = Mj^ — with a martingale and a nondecreasing process called 
the compensator starting from i7^(0) = 0. Hence Ui{0) — E[Ui{t)] = E[Di{t)] > 0 is the 
expected cost if one considers only stopping after r. 

Given the geometry of the boundary between A and C that we have identified in Proposi¬ 
tion 14.61 the increments of Dp are indeed given by the (absolute value of the) drift of L where 
the state is in A. 

Proposition 4.7. With b{x) as in Proposition \4. 6] and (Ao,Lb) A (OjO) have 

dDpit) = - y) dt (4.2) 

for all t G M+ a.s. If (Ao,lo) = (0,0), (14.2p still holds if y* < 0 or y-p > 0; otherwise 
dDp = 0. 

^^Formally we only have A = fl up to the origin by Proposition 14.61 but we prefer to work with the 
boundary representation. Precisely .4 3 C° PI and as h{x) lies below the preemption boundary y-p -Y x{r — 
p,Y)/{r — fix), in fact b(0) = miii{yp,y*), so we have (0,0) € C fl A iff y* > 0 > yv, resp. .4 = n iff 
y* < 0 or yp > 0. 

^®This “switching on and off” of the waiting cost could lead to non-trivial behavior, dependin g on the loca l 
time our process {X,Y) spends on the boundary between the two regions given by j/ = b{x). See l.Tack^ (llOO.ll'l 
for an example based on Brownian motion where that local time is non-trivial. 
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Proof: See appendix. 

With the concept of the Snell envelope we can now show that b is not trivial, i.e., not 
just the constraint applied to the unconstrained solution. 


Lemma 4.8. If y-p < y* , then also b < y*. 

Proof. Suppose b{x) = y* > yv, hence y* > 0. Then in particular for all Xq > x and Yq = y*, 
Uj^{0) = Lq = Lq = Ul{0) with Ul the (unconstrained) Snell envelope of L. For any stopping 
time T, 


U^{0)-E[U~^{t)]=E[D~^{t)]=E 


rrAr-p 


lyt>fe(Xt)e ^^{Yt - y) dt 


and similarly for the unconstrained problem 


Ul{0) - E[UUt)] = E[Dl{t)] = E 



lYt>y*e ''^{Yt-y)dt 


Let now Xq > x, Yq = y* and r = inf{t > 0 | < x} A r-p > 0. Then Ui{t) < Ul{t) on 

{Yr < y* Y which has positive probability by our nondegeneracy assumption, so E[Ui{t)] < 
This contradicts all other terms in the previous two displays being equal, respec¬ 
tively. □ 

Remark 4.9. It is a difficult problem to characterize b more explicitly. However, by similar 
arguments as in the proof of Lemma 14.81 one can obtain a scheme to approximate b (see also 
our numerical study in Section [S]). The Snell envelope U^, being a supermartingale of class 
(D), converges in L^{P) to 17^ (oo) = Also its martingale and monotone parts 

converge in L^{P) as t —>■ oo, respectively. If Yq > b{XQ), we further have Ui{0) = Lq = Lq. 
Therefore, 


U-AO) - EpA^)] =Lq- E[Lrp] = E 
= E[DA:^)]=E 


re-^\Yt-y)dt 

Jo 


nv 


ly>fe(Xt)e (Yt - y) dt 


and hence 


> b{Xo) 



lyi<6(Xt)e ''^iXt-v)dt 


= 0 . 


(4.3) 


Since y* > b, one can also use r-p A inf{t > 0 11) > y*} in (|4.3p . Any candidate b for b should 
satisfy b > y like b itself. Therefore, if b is (locally) too high (low), the expectation in (j4.3p 
will be positive (negative) for Yq = 6(Ao). 

^®For Yq > 0, the optimal stopping time for L, i.e., the first time Y exceeds y*, is unique (up to nullsets), 
but not admissible in the constrained problem for Yo,y-p < y*, so analogously Ui{t) < Ul{t) on {Yr < y*}. 


15 













4.4 Subgame Perfect Equilibria 

We are now ready to combine the previous results to construct equilibria for arbitrary sub¬ 
games. If the state reaches P, there is preemption with immediate switching by some firm. 
In the continuation region C, the firms just wait. In the attrition region A, however, the 
firms switch at a specific rate such that the resulting probability for the other to become 
(more profitable) follower compensates for the negative drift of the leader’s payoff, making 
each indifferent to wait or switch immediately. 


Proposition 4.10. Suppose {Xq,Yo) / (0,0) or y-p > 0. Fix ^ ^ and set r-p := inf{t > 
■d I Lt > Ft}. Then (G^ja^) defined by 


dGfjt) lY,>bix,){Yt-y)dt 

1 - Gf{t) Xt/{r - yx) - {Yt - yv)l{r - hr) 

on [??, Tp) and Gf{t) = I on [rp,oo] and 


afit) 


^Lt>Ft 


Lt-Ft 

Lt-Mt 


on [??, oo], i = 1,2, are an equilibrium in the subgame at i9. 
The resulting payoffs are 


(4.4) 




'^j) = Yi{X^,Y.fij = esssup£'[L^|^ij] 

T>'d 


with L := LI 




+ Pr-pl 


T^p ^t>Tp • 


Proof. Fix i G {1,2} and let j denote the other firm. The strategies satisfy the conditions 
of Definition 14.11 (presupposing Gf{t) = af{t) = 0 on [0,-d)). Note in particular that by our 
nondegeneracy assumption, rp = infjt >'d | L^ > Ft} unless (X^, Ijj) = (Xq, Yq) = (0,0) and 
yp = 0, and thus except for that excluded case the denominator in (|4.4I) will not vanish before 
Tp. Now y > Yt > b{Xt) implies t > rp by h{x) > min(y, yp-|-x(r — |Uy)/(r — px)) and hence 
the proposed stopping rate is also nonneeativel^ 

The strategies are mutual best replies at rp by Proposition 14.51 i.e., given any value of 
Gf(Tp—), Gf(t) = 1 on [rp,oo] and af{t) as proposed are optimal against [G'j,a^) and the 
related payoff to firm i is E[{1 — Gf(Tp—))(l — G‘j{T'p—))Frj> \ • It remains to show 

optimality of Gf on [i?, rp). Since G^ is continuous on ['d,rp) it follows from iRiedel and Stea 
( 2ni4r) that it is not necessary to consider the possibility that af{t) > 0. 

Given the proposed optimal af and Gf (t) = 1 on [rp, oo], the related payoff at rp and 


^^Given the proposed rate, Gf (t) = 1 — exp{— /j(l — Gf (s)) ^ dGf (s)} on [i?, r-p). 
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the continuity of Cj up to r-p, we can write the payoff from any Gf on [i?, r-p) as 


Vf{Gt,af,Gla^)=E 


[ ([ FtdG^{t) + {l-G^is))L)jdGtis) 

J[0,Tr]\J[0,s) ■’ J 

+ (1-Gf(rp-))(1-Gf(rp-))F.^ 


^,9 


Further, noting (1 - Gf(rp-))(l - G^{T-p-))Fr^ = AGf (rp)AG|(rp)F,^ and AG^(t) = 0 
on [0,rp), we obtain that 


Vf{Gt,at,G^,a^)=F 


J[0,T-p] 


Si{s)dGf{s) 




where Si{s) = FtdG’j{t) + (1 — G^{s))Ls. Thus Gf is optimal iff it increases when it is 
optimal to stop St. We now show that this is the case anywhere in the attrition region A or 


at rp. 

The process Si is continuous on { 9 ? < rp} because there Lr^, = TVp implies A5i(rp) = 
AGf (tp)(Ft-p — Lj-^) = 0. Since L is a continuous semimartingale and Gf is monotone and 
continuous on [0,rp), Si satisfies 


dSi{s) = {F, - Ls) dG^{s) + (1 - Gf (s)) dLs. 

Using (T, - Ls)dG^s) = (1 - Gf (s))ly^>fc(x,) e — y) ds on [i?, rp) yields 

dSiis) = (1 - G%s)){dLg + - y) ds). 

Recalling L from Subsection 14.31 (with rp adjusted for 1 ?), and its Snell envelope Ui and 
compensator identified in Proposition 14.71 we have in fact 

dSi{s) = (1 - G^{s)){dLg + dDi{s)) 

on [ 1 ?, rp] where d < T-p. We first ignore (1 — Gf) and argue that it is optimal to stop 
L + anywhere in the attrition region A or at rp. Indeed, as is the 

smallest supermartingale dominating L, Ui + D^ = must be the smallest supermartingale 
dominating L + D^, i.e., the Snell envelope of L + Dj^. As is a martingale, any stopping 
time r with M^^t) = Lt + Di{t) <t4 Ui{t) = Lj- a.s. is optimal for L + which is satisfied 
where the proposed Gf increases (i.e., in .A or at rp)Lj Instead of stopping L + we 

Proposition 14.61 AnC could only be reached at the origin, i.e., by {Xr, Yr) = (0,0) -tt* (Xq, To) = (0, 0) 
and if y-p = 0 (cf. footnote 1 1411 . which we have excluded, [/^(rp) = Lt-p holds by definition. 
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actually have to consider, for any r € [i?, r-p], 

5i(r) - Si{^) = [ (1 - G^{s)){dLs + dD^is)) 

= (1 - Gf (r)) (L. + Diir)) - - D^i^) 

+ f {Ls + D~^{s))dG^{s). 

The presence of (1 — G'j) thus acts like a constraint compared to stopping L + Dj^. However, 
G^ places its entire mass favorably, as it also only increases when it is optimal to stop L + Dj^. 
Therefore the payoff from optimally stopping Si is indeed that from L + i.e., = 

Ui{'d) (with = 0), and the same stopping times are optimal. The proof is now complete. 

□ 


The Markovian equilibrium stopping rate (|4.4I] is the (absolute value of the) drift of L in 
A divided by the difference F — L, ensuring the exact compensation that makes each firm 
indifferent as discussed before. Waiting is strictly optimal if (X, Y) G C, where the equilibrium 
payoff is 1/^ > L. 

Although the stopping rate (14.4p becomes unboundedly large as the state approaches the 
preemption region - because the denominator F — L vanishes while the numerator is bounded 
away from zero - the cumulative stopping probability does not converge to 1. There will indeed 
be some mass left when reaching the preemption boundary. This is a distinctive feature of 
our stochastic mode0 that is not observed in deterministic versions, cf. Section O 

Proposition 4.11. The strategies Gf specified in Proposition \4-l(J\ satisfy AGf{T'p) > 0 on 
{r-p < oo} a.s. 


Proof: See appendix. 


Concerning the regularity of Oj, note that we can only have L < M on {Y < y-p} by our 
assumption (cq — CAfjr + / > 0, whence L > M on {(X, T) GPU dV} a.s. if Xq > 0; so Oj 
will be continuous and vanish on {(X, T) G 9P}@ 


^®The mathematical question underlying Proposition 14.111 is of interest in its own right. With the same 
arguments used in the proof (which then become much simpler) one can show that for a Brownian motion B 
started at a > 0 one has 




dt < oo 


a.s., where tq — inf{t > 0 | Bt < 0}. We actually consider the reciprocal of the process Zt = Xt — Yt + a with 
our geometric Brownian motions X, Y. 

^°In the particular case Xq — 0, X = 0 and 


ai{t) 


Lt - Ft ^ _ {Yt - yv)lYt>yj, _ 

Lt-Mt Yt-yv + {r-nyfil-{cA-co)/ry 


Then at will still be continuous for I > {ca — cfi/r and unity on {Y > y-p} for I = {ca — co)/r. 
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We can easily aggregate the equilibria to a subgame perfect equilibrium since all quantities 
are Markovian. 

Theorem 4.12. The strategies i = 1,2 of Proposition form a subgame 

perfect equilibrium. 

Remark 4.13. If Xq = 0 < Yq, the game is played “on the y-axis” and the derived equilibria 
are as follows. There is preemption as soon as Y exceeds the preemption point y-p. Any y 
less than 6 ( 0 ) = min(y-p,y*) is in the continuation region, so there is attrition iff (y*)^ < yv, 
between those points. 

If Yq = 0, the game is played “on the x-axis” and is actually deterministic since we then 
have r-p = oo by our assumption y-p > 0. In fact, now Ft > LtVt € M+ if Aq V yp > 0, and 
dLt = e~'"^ydt. Thus, if y > 0 , stopping is dominated for t € M+, strictly if y > 0 or against 
any strategy that charges [ 0 , oo), while the proposed equilibrium strategies only charge [oo]@ 
If y < 0, also 6 = y* < 0, and there is permanent attrition with rate —dL/{F — L). 

In the completely degenerate case that further Xq = yp = 0, the stopping rate of Propo¬ 
sition I4.1UI is not well defined. Now, however, L = F and there are the following equilibria: 
for y > 0 , both firms wait indefinitely, for y = 0 , any strategy pair with no joint mass points 
are an equilibrium, and for y < 0 , one firm switches immediately and the other abstains. 


5 A Numerical Example 

As an illustration of the model we present a numerical example to show the consequences of 
the results presented so far. The parameter values of our base case are given in Table [TJ 

Co = 3.5 CA = 4.5 cb = 5 I = 100 r = .1 
Py = -04 yx = -04 ay = .25 ax = .25 p = .4 

Table 1: Parameter values for a numerical example 


For this case it holds that y* = 17.45. The preemption region is depicted in Figure [23 
Finding the boundary x b{x) as characterized in Proposition 14.61 is not trivial as can be seen 
from Remark However, it is kn own from th e liter ature on numerical methods for pricing 
American options (see, for example, iGlassermanl . l2004l for an overview) that a piecewise linear 
or exponential approximation often works well. In our case, we hypothesize an exponential 
boundary of the form 

6(x)=y*-(y*-y)e-^("-"), 


where x is the unique such that (x, y) is on the boundary of V, and 7 is a free parameter. 

^^Indeed, if y = y* = 0, b = 3 /* = 0, while if y > 0 4A y* >0, then b{Xt) > 0 for No + y-p >0 by 
b{x) > min(y, yp + x{r - UY)/{r - px))- 
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A rough implementation now consists of hypothesizing a value for 7 , followed by simulating 
3,000 sample paths for several starting values close to this boundary. The optimal boundary 
should be such that simulated continuation values are uniformly slightly larger than the 
leader value. Using a manual search across several values for 7 suggests a value of .0984 and 
a boundary as depicted in Figure!^ 




(a) Preemption region 


(b) Optimal stopping boundary for 
constrained leader value 


Figure 2: Preemption, attrition and continuation regions for numerical example. 


Once the boundary is established we can simulate equilibrium sample paths using the 
equilibrium strategies from Theorem 14.121 Two sample paths, together with their realizations 
of the attrition rate (j4.4p are given in Figures [3] and 01 In parallel to the paths we sample 
the investment decisions from the respective attrition rates. The displayed paths end where 
investment takes place. 



Figure 3; Sample path ending in preemption and its realized attrition rate. 
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Figure 4: Sample path ending in attrition region and its realized attrition rate. 


Note that, even though the two sample paths start at exactly the same point {Xq,Yo) = 
(6, 8), their equilibrium realizations are very different. In the sample path t i—>■ (Xt(cji), lt(a;i)) 
in Figure [3 the attrition region is entered and exited several times before, finally, the sample 
path hits the preemption boundary. At that time the realized attrition rate has gone up 
to about ^ .045, j = 1,2. However, no firm has invested up to time T-p{uJi). 

At time we have = (1,0), j = 1,2, so that (see 

Appendix lA.21) each firm is the first to invest at time T'p{u:i) with probability = .5. 

So, the wi sample path ends with investment taking place when there is, just, a first-mover 
advantage. In the sample path t (At(a; 2 ), lt(a; 2 )) in Figured the attrition region is again 
entered and exited several times. Note that the first entry of the attrition region is at roughly 
the same time as along the oji sample path. At time 2.5 (approximately), when the attrition 
rate realization has gone up to Gj(1.4) k, .07, j = 1,2, one of the two firms actually invests, 
thereby handing the other firm the second-mover advantage. 

Finally, we run a simulation of 3,000 sample paths, all starting at (Ao,yo) = (6,8), and 
record whether the game stops in the attrition or preemption region. We find that 80% of 
sample paths end with preemption, whereas 20% of sample paths end in the attrition region. 
A scatter diagram of values (Ai.,-(^), l%(i^)) at the time of first investment is given in Figure 
The average fraction of time spent in the attrition region is 6.76% and all of sample paths 
experience attrition before the time of first investment. The value of immediate investment 
is -16.67, whereas the (simulated) value of the equilibrium strategies is 12.02. 


^This figure excludes outliers in both dimensions. 
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Figure 5: Scatter plot of realizations of 

6 Differences between Deterministic and Stochastic Models 

For comparative purposes, we now briefly analyse a deterministic version of our model, i.e., 
setting ax = cry = 0. The expressions for Lt, Ft and Mt provided in (|2.2I) then remain 
the same. In order to avoid the distinction of many different cases, we concentrate on the 
most “typical” one representing the economic story that we have in mind. Therefore assume 
that the market B is growing at the rate fiy > 0 from the initial value Tq > 0. Further 
assume that u y > nx, so that it is only market B that can possibly overtake the other, A, 
in profitabilityo The same holds then for the functions L and F: Now we have preemption 
due to Lt > Ft iff {Xt, Yt) G P, which is iff 

f -> cb-ca ^ j 

\r - r - nx } r 

fix > fiY and Xo > 0, the behavior differs from that discussed in the main text as follows. Now the 
profitability of market A will eventually outgrow that of market B and preemption occurs during a bounded 
time interval (if at all). Indeed, since 

d{Lt — Ft) _ I fivYo _ fixXp 

dt \r - fiY r - fix 

has at most one zero and is negative for t sufficiently large, {Lt — Ft) grows until its maximum and then 
declines, so {t \ Lt — Ft > 0} forms an interval (if nonempty). Arranging {Lt — Ft) similarly as (16.11) shows that 
{Lt — Ft) is negative for t sufficiently large, which bounds the previous interval. 

Supposing that the preemption interval is nonempty and that fiY > 0, the unique maximum of Lt attained 
at t = t may occur before, during or after preemption. We can observe attrition followed by preemption only 
in the first case, i.e., if Lf < Ft and d{Lt — Ft) > 0, which is if Xtl{r — fix) (see the right of (16.31) 1 lies in 
(^y/{r — fiY) — {cB — CA)/r — I,fiYy/{fix{r — fiY)))- This interval is nonempty, e.g., ii fix and /ry are sufficiently 
close. 

In subgames after the preemption interval there will be indefinite attrition for all t > i. 
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The LHS is the product of two nondecreasing functions and the RHS is nonnegative by our 
assumption made in Section [51 Hence Lt > Ft for all 


t > inf{t > 0 I Li > Ft} =: t-p 


and preemption will indeed occur iff the LHS of (lfi.2p ever becomes positive, i.e., tp < oo ^ 
IJ-Y > ^J-x or Yo/{r — /iy) > Xo/{r — nx)- Preemption does not start immediately at t = 0 iff 
Yo/ir - /iy) - Xo/ir - px) < {cb - CA)/r + /, i.e., tp > 0 4^ (^0,^1)) ^ F. 

Now the constrained stopping problem to maximize Lt over t < tp is very easy. As Lt is 
increasing iff T* < y, i.e., iff To < V and 


t < — In — ) =:t, 


PY 


To 


the solution is to stop at the unconstrained optimum t = t (resp. at t t := 0 if Tq > y) or 
at the constraint t = tp if it is binding. The solution is also unique since Lt in fact strictly 
increasing for < y and strictly decreasing for Yt > y. 

As a consequence, stopping is strictly dominated before the constrained optimum min(t, tp) 
is reached and we can only observe attrition in equilibrium if the unconstrained maximum of 
L is reached before preemption starts. It indeed holds that L^ < Fj (given Tq < y) iff 




Yt 

r- PY 

y 

r- PY 


CB - CA _ j ^ 

r r - px 

CB - CA _ j ^ 

r r - px 


Xq / Ji \ 
r - px \ YoJ 


(6.3) 


(and Lq < Fq 4^ (Ao,To) 0 V for Yq > y), so that there will be attrition iff the initial 
profitability Xq of market A is large enough to let T* exceed y before {Xt,Yt) € P0 Once 
Yt > y, resp. t > t, Lt strictly decreases and we observe attrition until preemption starts at 
tp. 

The equilibrium can now be represented as in Proposition I4.1U1 resp. Theorem 14.121 with 
the fixed preemption start date tp replacing Tp{'d) throughout and t>t replacing the dynamic 
attrition boundary Yt > h{Xt). Note that if there is attrition before the preemption region is 
reached, stopping will now occur with probability 1 due to attrition^ 

px 7^ 0, the path that (Xt,Yt) takes in the state space R-X is given by the relation y = Yo{x / ^ 

For px ~ 0, it is of course just {(Xo,y) | y > To}. 

^®In analogy (in fact contrast) to Proposition 14. 1 11 and its proof it suffices to verify that 

T"’ dt 

X X-Y+a-"^ 

when in the simplified notation r-p = inf{t > 0 | N* — T < a} G (0,oo), since we are only interested in the 
case Yrj, > y so that Yt is bounded away from y near Tp, where the above integral explodes. Indeed, with 
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As a numerical example, we use the same parameter values as before, but set ax = uy = 0. 
For easy reference, the left-panel of Figure El includes the approximate boundary for the 
attrition region as derived in Section [SJ Note that for each sample path it is clear a priori 
that the game ends in attrition and that, once the attrition region is entered, it will never be 
exited again. As a result, the equilibrium attrition rate is a smooth function of time as can 
be seen in the right-panel of Figure El In this example non of the sample paths will ever end 
in preemption. 




(a) Sample path (b) Attrition rate 

Figure 6: Paths and attrition rates for deterministic case. 

If, however, we take the same example, but with fiy = -06 and fix = -02, then the 
situation is very different. Figure [71 shows three sample paths that all end in preemption. 
Consequently, the attrition rate increases smoothly to 1 at the time the preemption region 
is hit. This is, again, very different from the typical sample path of the attrition rate as 
discussed in Section El 


7 Concluding Remarks 


In this paper we have built a continuous time stochastic model capturing a natural strategic 
investment problem that induces a sequence of local first- and second-mover advantages de¬ 
pending on the random evolution of the environment. Our focus has been mainly on regimes 
with second-mover advantages, as these are far more rarely considered in the real options lit¬ 
erature. Despite the non-predictable development of the game we have constructed subgame 


Zt = Xt — Yt + a we have limt_»Tp Zt = 0 and dZt = (pxA'oe''^* — dt and hence 


oo = lim — In(Zt) = — In(Zo) — 

t — >T-p 


Xt-Yt+a 


dt. 


As the numerator in the integral is bounded on the assumed finite interval [0, rp], the claim follows. 
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(a) Sample path (b) Attrition rate 

Figure 7: Paths and attrition rates for deterministic case. 

perfect (Markovian) equilibria, for which we made use of different approaches from the theory 
of optimal stopping - given that we identified stopping problems at the heart of equilibrium 
construction that are not standard in the literature. 

Even though we have made some strong assumptions on the underlying stochastic pro¬ 
cesses, choosing a quite specific form, it should be clear that our results - in particular the 
economics driving our equilibria - can be generalized to other underlying payoff processes. 
The assumption of geometric Brownian motion is mainly made so that the leader and follower 
payoff processes can be explicitly computed. 

An economically important avenue for future research is to enrich the economic environ¬ 
ment by introducing a continuation value for the follower. This could be even extended to a 
model where firms can switch as often as they wish. Such an extension, however, does not 
fall into the framework of timing games employed here, but will require a richer model of 
subgames and, particularly, histories (of investment). 
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A Appendix 


A.l Proofs 

Proof of Proposition 14.61 First consider Iq = Oj which is absorbing. By our assumptions 
yv > 0, so (M+,0) C V^. For Y = 0 hence r-p = oo (so we face an unconstrained, deter¬ 
ministic problem) and thus (x,0) G C 4^ V£(x,0) > F(0,0) 44 0 < y* hy the solution of the 
unconstrained problem, or directly from dLt = e~''^ydt for Fq = 0 and y* > 0 44 y > 0. In 
this case r^c = oo is optimal, and r^c = 0 if ?/* < 0. 

We now establish the monotonicity of the stopping and continuation regions for L in the 
whole state space by strong path comparisons. Therefore denote the solution to (12.11) for 
given initial condition (Xo,lo) = {x,y) G by = (xX^,yY^). Further write 

the continuation region as C = {{x,y) G M.‘^\Vi{x,y) > L{x,y)} C where L{x,y) := 
y)g-pc + F(0, x)l( 3 , cf. (12.21) . This means that if we fix any (xo,yo) € Cj then 
there exists a stopping time r* € (0,rp] a.s. with Ip(xo,yo) > P[Pr*] = E[L{t*^Y^°)\ > 
L{xo,yo) = L{0,yo). Now fix an arbitrary e € (0,yo) implying that ,Yy°~^) = (X^o,yyo_ 
eY^) starts at (xq, yo — e) GV^ and t* < Tp < inf{t > 0 | {X^°,Y^^°~^) G V}. 

Hence, Vi{xo,yo-e) > E[L{t*,Y yr^)] = E[L{t* eY^\/{r-yy)] > ^y^)- 
E\e~'^'^*sY^t/{r—yY)\ > L{0,yQ)—e/{r—yY) = L(0,yo~£) = L{xo,yQ—e). The last inequality 
is due to being a supermartingale by r > yy- 

As e was arbitrary we can define b{x) := sup{y > 0 | Vi(x,y) > L{x,y)} for any x G M+ 
where that section of the continuation region is nonempty and conclude Vi{x,y) > L{x,y) 
for all y G (0,6(x)). Then we have h[x) < y* because immediate stopping is optimal in the 
unconstrained problem for Yq > y*, formally L(0,y) = L{x,y) < Vi{x,y) < Ul{0) = L(0, y) 
for any (Xq, Fq) = {x, y) G with y > y*Cj The same argument shows that the continuation 
region is empty if y* < 0. In this case we can set b{x) ■= y*. 

The section of the continuation region for arbitrary x > 0 is in fact only empty if y* < 0, 
which completes the definition of b. Indeed, we have seen at the beginning of the proof that 
(M+,0) C C if y* > 0 (and therefore actually (x,y) G C for all y G [0,6(x))). We could 
also have applied the following important estimate for x > 0. If y* > 0, i.e., if y > 0, then 
b{x) > min(y, yp -|- x(r — yY)/{r — yx))-, which follows from the fact that L is a continuous 
semimartingale with finite variation part 

f -e~''%Ys - y)ds, 

Jo 

as can be seen from applying Ito’s Lemma. This drift is strictly positive on {y < y}, where 
stopping L is therefore suboptimal and so it is too for L (up to rp). 

^®Here Ul is the Snell envelope of L , i.e., the value process of the unconstrained stopping problem. See also 
the corresponding discussion for L following Proposition 14.61 
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For the monotonicity of b pick any (Xo,lo) = ixo,yo) S C and r* < r-p as before and fix 
an arbitrary e > 0. Then + eX^,Y^°) starts at (xq + £,yo) S and 

T* < TV < inf{t > 0| e V}. Now Vi{xo + e,yo) > E[L{t*^S)] > L(0,yo) = 

L(xo + e, yo)) whence b{xQ + e) > b{xo). 

The continuity of 6 in xq = 0 holds by the following estimates. Below we show that b(x) > 
min(yp,y*), which together with monotonicity yields a right-hand limit and 6(0), 6(0+) > 
min(yp,y*). On the other hand, by definition 6(x) < yp + x(r — yy)/(r — yx) and 6(x) < y* 
as shown above. Hence 6(0) = 6(0+) = min(yp,y*). To verify the continuity of 6 in xq > 0 
we show that if (xo,yo) € C, then also the line {(x,y) € | x € (0,xo],y = xyo/xo} C 

As the first step, we check that given {Xq, Yq) = (xq, yo) € T-p < inf{t > 0 | (Xf, Y^) € V} 
for any point (x,y) on the specified line. Indeed, for any (X*,y^) we can write 


Lt< Ft 4^ 

<+> 


Yr 


Xf 


< 


CB - CA 


r - VY r - yx 


y 


r- VY 


-Yl- 


X 


r - vx 


-xl< 


+ / = 
yv 


r - VY 


yv 

r - VY 


If y = xyo/xo this becomes 


r- VY 


X 

r - fix 


X 


Xq \r - fiY 


Xq 

r - fix 



< 


yv 

r - fix' 


As yvl{x — fix) is nonnegative, the condition for (x,y) is implied by the one for (xo,yo) if 
X E [0, Xq]. Therefore, if we fix any point on the line {(x,y) E |x E (0,xo],y = xyo/xo}, 
we have t* < inf{t > 0 | {Xf ,Y^) E V}, where r* as before satisfies £'[L(t*, y,^^)] > L(0, yo) 
for the given (xo,yo) E C. 

In particular (x,y) E V^. Now suppose also (x,y) E C^. Then L(0,y) = Vi{x,y) > 
E[L{T*,Yy,)] = E[L{T*,YyS) - e-""*(yo - y)/(r - /ry)y,b] > L(0, yo) - E[e-'^-\yQ - y)/{r - 
+y)yy.] > L(0,yo) — (yo — y)/{r — fix) = L{0,y), a contradiction (where we again used the 
fact that (e“'’*y^) is a supermartingale). Thus, (x,y) E C. 

Now we argue that dC C C^, except possibly for the origin. Suppose y* > 0, i.e., y > 0 
(otherwise C = 0). By 6(x) > min(y,yp + x(r — fiY)/{r — fix)), the only point in dC with 
y = 6(x) = 0 can be the origin (and that only if yp = 0). If y = To > 0 and (Xo; ^o) £ dC, 
then (X, y) will enter the interior of immediately with probability 1. Indeed we have shown 
that 6(x + h) < 6(x) + hb{x)/x for any x, 6, > 0, which implies with the monotonicity of 6 that 


graphical illustration helps to convey the continuity argument for b{x). 


y 

yo 



-> 

Xq X 
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if Yo = b{Xo) > 0 and Xq > 0 , then {Yt > b{Xt)} D {Yt > Xo} n {Yt > YoXt/Xo} = {(/iy - 
aY/ 2 )t+aYBY > 0 }n{(/iy — (Ty/ 2 )t+(Tyi 3 j^—(/ix—o'x/ 2 )t —axB^ > 0 }. After normalization 
we see that the latter two sets are both of the form {Bt + /ut > 0 } for some Brownian motion 
B with drift /i E M (we normalize by ay in the first and (ciy — IpaxO'y + in the second 

case; recall ayB^ and ayB^ — axB^ are not degenerate). Therefore, the hitting times of 
either set, which we denote by ri and T 2 are 0 a.s., and P[inf{t > 0 11* > b{Xt)} = 0 ] > 
1 — P[ti > 0] — P[t 2 > 0] = 1, i.e., the correlation p between B^ and B^ is not important. 
A simpler version of the argument applies to the case Xq = 0 and Yq = 6 ( 0 ) > 0 , when 
{Yt > b{Xt)} = {Yt > To}. 

It remains to prove that b{x) > min(yp,y*). If y* < y-p then r-p > T*{y) := inf{t > 
0|Xt > y*} for (Xo,lo) = {x,y) E and thus E[L^,(^y)\ = [/^(O) > Vi{x,y) > E[L^*(^y)]. 
Hence, 17^(0) = Vi{x,y) > L{0,y) = L{x,y) for y < y*, implying b{x) > y*. 

For y* > y-p we will show that L(x, y) = L(0, y) < E^L^t^y^-^^ < V^(x, y) for any (x, y) with 
y < yp, where T{yp) := inf{t > 0 | Y) > yp} < Tp, which implies that b{x) > yp. On {Yq = 
y < yp} we obtain by the definition of yp that E[L^(^y^^] = — co/r + {y/yp)^^{co — c^l/rP^ 
which is a continuous function of y that extends to E[L^^y^-j] = L{0,yp) for Yq = y = yp 
and to E[L^(^y^^] = —cofr for Yq = y = 0. Hence, E[L^(^y^^] — L(0,y) vanishes at y = 
yp, while at y = 0 it attains I + {cp — co)/r, which is strictly positive if y* > 0. Now 
dyE[L^l^y^-^ - L{0,y)] < 0 for all y E (0,yp) iff (3i{cq - CA){y/ypY^~^ < cp - ca + rl for all 
y E (0,yp), iff /3i(co - ca) < cp - ca + rl (since (3i > 1), i.e., iff y* > yp. □ 


Proof of Proposition 14.71 As in the proof of Proposition 14. til we begin with the determin¬ 
istic case Yq = 0, whence rp = oo and dLt = e~^^ydt. In this case the Snell envelope of 
L = L is the smallest nonincreasing function dominating L. For y > 0 y* > 0, it is just 
the constant Loo = —cqIt and thus dDi = 0, while for y < 0 y* < 0 it is L itself and thus 
dD^ = —dL. Both correspond to the claim, cf. also Remark 14.131 


For Yq > 0 = Xq, the solution is by Proposition 14.61 to stop the first time Y exceeds 
6(0) = min(yp,y*). Then the Snell envelope is explicitly known for t < Tp, as in footnote 
[55] with y = min(yp,y*), inserting Y) and discounting the brackets by (and = L for 
Y > y). In this case dD^ can be determined as the drift of from Ito’s formula. One can 
also reduce the following argument to the 1-dimensional case. 

For Xo,Yo > 0 first note that the Snell eii v elope = V^(X, T) is continuous because 
V^(-) is a continuous function; see, e.g., iKrvlovI (|l98flh . The question when is exactly the 
decreasing component of the continuous semimartingale L in the stopping region is addressed 


^®For any threshold y > 0 and its hitting time r(y) := inf{t > 0 | Yi > y} by the geometric Brownian motion 
Y we have by standard results 


P[^T(y)] - + 


y 


y 

r - py 


cb — Co 


- 7 if Yo < y. 
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by I Jackal ([l99j) : It is the case if the local time of the nonnegative semimartingale — L at 
0 is trivial, i.e., if L^{Uj^ — L) = 0 (a.s.). We can show that the latter is indeed true in our 
model by applying the argument of Jacka’s Theorem 6. 

Specifically, Ito’s Lemma shows that L is a continuous semimartingale with finite variation 
part At := /q —ls<:T-pe~^^(Yg — cb + cq — rl) ds. Denote its decreasing part by A~, which here 
satisfies 

dAt = lY>y e~''\Yt - CB +Co - rl) dt 


for t < T-p- By Theorem 3 of Jacka (1993), dLt{Ui — L) < ljj_ dA^, and as in his 

Theorem 6, dL^{Ui — L) is supported by {{X,Y) G dC}. 

If we let A~ as above for all t G M_|_, 


E[L^,{U^-L)]<E 


l{x,y)eac,s<Tp dAg 


< E 


l(x,y)e5C dA^ 


dA~ apparently has a Markovian density with respect to Lebesgue measure on ii+, and 
our underlying diffusion (X, Y) has a log-normal transition distribution, which thus has a 
density with respect to Lebesgue measure on R^. As dC = {{x,y) G | y = b(x) } has 
Lebesgue measure 0 in R^, we conclude like in the proof of Theorem 6 of I Jackal ( 1993f l that 
L^{Ui - L) = 0 (a.s.). □ 


Proof of Proposition 14.111 We need to show that 


dGfjt) ^ rT’ - y) dt 

Jo l-Gf{t) Jo Xtl{r - y,x) - {Yt-yp)l{r - y,Y) 


on {r-p < oo} a.s. Note that r-p = inf{t > Td\ Lt > Ft} if (Aq, Tq) 7^ (0,0) or yp > 0 (see the 
proof of Proposition I4.1U1) . As Y is continuous, it is bounded on [0,rp] where this interval 
is hnite. Hence we may just use dt as the numerator in (|A.ip . We will also ignore (r — yix) 
and (r — yy), which may be encoded in the initial position (Ao,To)- By the strong Markov 
property we set ?? = 0. Hence, we will prove that 


r^o 


dt 


Xt-Yt +a 


< oo 


(A.2) 


on {tq < oo} a.s. for nonnegative geometric Brownian motions X and Y (under our non¬ 
degeneracy assumption (T^,(Ty > 0, \p\ < 1), some hxed level a > 0 and the stopping time 
Te := inf{t > 0\Xt — Yt + a < e} with e = 0. We will treat the special case yp = a = 0 at the 
very end of the proof. Define the process Z := X — Y + a to simplify notation. 

As a first step and tool, we derive the weaker result ln{Zt) dt] G R for any time 

T > 0 (which implies also Jq° |ln(Zt)| dt < oo on {tq < oo} a.s. by the arguments towards the 
end of the proof). 
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Define the function /: ]R_|_ —> R by 


f{x) = xln(x) — X € [—l,x^] 

and the function F: R+ — R by F{x) = fg f{y) dy G [—x,x^], such that F"{x) = ln(x) for 
all X > 0. For localization purposes fix an e > 0 and a time T > 0. By Ito’s formula we have 

/•TjAT 1 fTgAT 

F{Zr,^T) = F{Zo)+ / f{Zt) dZt + - \n{Zt) d[Z]t 
JO ^ Jo 

rr^AT 

= F{Zo)+ / f{Zt){iixXt - lirYt) dt 
Jo 

rr^AT , . 

+ J f{Zt) [axXt dBf - ayYt dBj ) 

1 fTeAT 

+ - / ln{Zt) {a\X^ + alY^ - 2pax(JYXtYt) dt. 

^ Jo ' - V -" 

=-.a^iXt,Yt) 

We want to establish lim^^ofirst in terms of the integrals, for which we need 
some estimates. 

In order to eliminate the second, stochastic integral by taking expectations, it is sufficient 
to verify that lt<rofiXt)Xt and Ikt-q f{Zt)Yt are square P 0 dt-integrable on D x [0,T]. 
We have \f{Zt)\ < 1 + Z^. For t < tq further 0 < Zt < Xt + a by Yt > 0 and hence 
Yf < {Xt + o)^ < 2X^ + 2a^. The sought square-integrability with X follows now from the 
P 0 df-integrability of X” on D x [0, T] for any n G N and analogously that for Y thanks to 
0 < Yt < Xt + a foT t < tq. 

The same estimates guarantee that the expectation of the first integral converges to the 
finite expectation at tq as e \ 0. For the third integral we have h\[Zt) < Zt < Xt + a. The 
second term a‘^{Xt,Yt) is bounded from below by {axXt — ayYt)'^ > 0 and from above by 
{dxXt + ayYtf < {{ax + aY)Xt + aya)"^ < 2{ax + aY)‘^Xt + 2(Tya^ for f < tq (supposing 
cx, fy > 0 wlog.). Hence the positive part of the integrand is bounded by a P0 dt-integrable 
process on H x [0, T], while the negative part converges monotonically, and we may take the 
limit of the expectation of the whole integral. 

That the latter is finite follows from analysing the limit of the LHS, lim^^o-^'[.^(■^TsAr)]; 
directly. We have F{Zt^xt) = lTe<TF{£) + 1t<tsF{Zt), and it is continuous in e \ 0. For 
T < To again 0 < Zy < Xy + a and thus \F{Zy)\ < \Zy\ + \Zy^ < {Xy + a) + {Xy + a)^. As 
also |P(£)| < 1 for all e < 1, |P(Zt-jAt)| is bounded by an integrable random variable as e \ 0. 
Consequently, lime\o E[F{Zr^,^y)] = E[F{Zt-^xt)] G ^ and also E[JA^'^ ln{Zt)a‘^{Xt, Yt) dt] G 
R on the RHS. In the integral we may ignore the term a‘^{Xt,Yt), which completes the first 
step. Indeed, with |yo| < 1 we can only have a‘^{Xt,Yt) = 0 if Xt = Fj = 0, i.e., if Zt = a. 
Therefore inf{iT^(Xt, Ft) | 0t < e} > 0 for any fixed e G (0,a), so a'^{Xt,Yt) does not “kill” 
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the downside of In(Zt) and 


E 


■ ptoAT 


[JO 


In(Zt) dt 


G R. 


In the following we further need \n.{Zt)Xt dt] G R, which obtains as follows. With 

\p\ < 1, Yt)\ Zt < s} is attained only with the constraint binding, Yt = Xt + a — e. 

Thus, for Zt < s, a‘^{Xt,Yt) > a‘^{Xt,Xt + a — e). The latter is a quadratic function of 
Xt, with Xt having coefficient 1) > 0 given \p\ < 1. The quadratic function hence 

exceeds X for all X sufficiently large, i.e., we can pick K > 0 such that cr'^{Xt,Yt) > Xt 
on {Zt < e} n {Xt > K}. Xt thus does not “blow up” the downside of ln{Zt) more than 
a^X^Yt). 

We are now ready to analyse 


fiz- 


TeAT) = 


pt^AT 1 pTeAT 1 

/(Zo)+ / lniZt)dZt + -l —d[Z]t 


/o 


/o 




pTeAT 

= /(Zo)+ / ln{Zt){pxXt - pyYt) dt 
Jo 


pTsAT , V 

+ ln{Zt) [axXt dBf - uyYt dBj ) 


pTgAT 


+ - 


z 


■a\Xt,Yt)dt 


when taking the limit e \ 0 under expectations as before. By our final observations of 
step one the hrst integral converges (note again Yt < Xt + a for t < tq). In the second, 
stochastic integral we now have |ln(Zt)| < |ln(e)| + \Zt\ for t < r^, an even smaller bound than 
above, making the expectation vanish. In the third integral, a‘^{Xt,Yt)/Zt > 0 for t < tq, so 
monotone convergence holds. 

On the LHS, is bounded by an integrable random variable for all e < 1 

analogously to the first step, implying \\m^\^QE[f{ZT-^xT)] = E[f {Zr^xr)] G R and thus 
^"^{XtiYt)/Ztdt] < oo. By the same arguments brought forward at the end of the 
first step we can again ignore a^{Xt,Yt). 

With ^/Ztdt] < oo, T’[{to < T} n {/g^“ l/Ztdt = oo}] = 0. As T was arbitrary, 

we may take the union over all integer T to conclude P[{to < oo} O {/^ IjZt dt = oo}] = 0. 
This completes the proof of (IA.2P for the case a > 0 (and that of (lA.lIl for y-p > 0). 

Some modification is due for the case y-p = a = 0 and if (A"o,Tb) 7 ^ (OjO) (otherwise 
Tq = 0 and (IA.2h is trivial). Then a‘^{Xt,Yt) is not bounded away from 0 for Zt small, it may 
be an important factor in the integrability of \ii{Zt)a'‘^{Xt,Yt) when {Xt,Yt) is close to the 
origin. In order to infer the required well-behaved limit of li^{Zt)(pxXt — pyYt) dt] 

and to finally remove cr'^{Xt,Yt) from a^(Xt, Yt)lZt dt, one can employ another localization 
procedure: Fix a small 5 > 0 and use the minimum of as ■= inf{t > t)\Xt + Yt < 5} and 
Te f\T everywhere above. Then a‘^{Xt,Yt) is bounded away from 0 on [0 ,<75 A tq] for \p\ < 1 
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and again bounded below by a quadratic function with X‘^ having coefficient 1 ) > 0 . 

The result now obtains as above for all paths with + Yt > 6 on [0, tq]. As (^ > 0 is indeed 
arbitrary and any path with (Aq, Tq) / (Oj 0 ) is bounded away from the origin on [ 0 , tq] finite 
by continuity, the claim follows. □ 


A.2 Outcome Probabilities 


The following definition is a simplification of that in iRiedel and Sted (|2014l l. resulting from 
right-continuity of any af {■) also where it takes the value 0 . 

Define the functions fii and from [0,1]^ \ (0, 0) to [0,1] by 


l^L{x,y) := 


- V) 

x + y - xy 


and yLM{x,y):= 


xy 


x + y — xy 


fj.L{ai,aj) is the probability that firm i stops first in an infinitely repeated stopping game where 
i plays constant stage stopping probabilities a* and firm j plays constant stage probabilities 
<ij- yM{o,i,aj) is the probability of simultaneous stopping and 1 — fiLicLijO-j) — = 

fiL{aj,ai) that of firm j stopping first. 

Definition A.l. Given i} € ^ and a pair of extended mixed strategies (Gf, of ) and (G^jO;^) , 
the outcome probabilities 2 and at f'^ := inf{t > | af (t) + a 2 {t) > 0 } are defined 

as follows. Let i,j G {1, 2}, i 7 ^ j. 

If < ff := inf{t > ?? I af (t) > 0}, then 


+ ■■= {1 - G?+-))at(fO)Aa"(fO). 


If < ff := inf{t > ?? I af (t) > 0}, then 


:= (1 - Gf - a,(f’^))AGf(f’^), 

:= (1 - Gf (f’^-))af (f’^)AGf (f"). 

If = ff = ff and af (f’’) + afif^) > 0, then 


+ := {1 - G?(f'’-)){1 - Gj(f'’-))M(af (f").a"(f‘')), 

4l := {1-Gf+-)){!+ + 
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If = ff = f 2 and af (f’^) + = 0, then 

Ali:=(l-G?(f’>-))(l-Gj'(f’>-))i| liminf f,Uat{t),a*{t)) 

af(t) + a^(t)>0 

+ limsup /iL(af(t),af(t)) >, 

t\.T^ J 


t\T'^ 
af(t) + af(t)>0 


X% 0 . 


Remark A.2. 


(i) is the probability of simultaneous stopping at while is the probability of 


firm i becoming the leader, i.e., that of firm j becoming follower. It holds that A^^ + 
Xh + Xtj = (1 - Gf(f’^-))(1 - G^if^-)). Dividing by (l - Gf(f’^-))(l - 


where feasible yields the corresponding conditional probabilities. 

(ii) If any = 1, then no limit argument is needed. Otherwise both are right-continuous 
and the corresponding limit of fiM exists, /i^, however, has no continuous extension at 
the origin, whence we use the symmetric combination of lim inf and lim sup, ensuring 
consistency whenever the limit does exist. If the limit in a potential equilibrium does 
not exist, both firms will be indifferent about the roles: see Lemma A.5 in Eiedel and 
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